Multi-Modal Visual Place Recognition in Dynamics-Invariant Perception Space

نویسندگان

چکیده

Visual place recognition is one of the essential and challenging problems in fields robotics. In this letter, we for first time explore use multi-modal fusion semantic visual modalities dynamics-invariant space to improve dynamic environments. We achieve by designing a novel deep learning architecture generate static segmentation recover image directly from corresponding image. then innovatively leverage spatial-pyramid-matching model encode into feature vectors. parallel, encoded using popular Bag-of-words model. On basis above features, finally measure similarity between query target landmark joint their codes. Extensive experiments demonstrate effectiveness robustness proposed approach

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Multi-modal Semantic Place Classification Multi-modal Semantic Place Classification

The ability to represent knowledge about space and its position therein is crucial for a mobile robot. To this end, topological and semantic descriptions are gaining popularity for augmenting purely metric space representations. In this paper we present a multi-modal place classification system that allows a mobile robot to identify places and recognize semantic categories in an indoor environm...

متن کامل

Towards Condition-Invariant, Top-Down Visual Place Recognition

In this paper we present a novel place recognition algorithm inspired by recent discoveries in human visual neuroscience. The algorithm combines intolerant but fast low resolution whole image matching with highly tolerant, sub-image patch matching processes. The approach does not require prior training and works on single images (although we use a cohort normalization score to exploit temporal ...

متن کامل

Omnidirectional Visual Place Recognition using Rotation Invariant Sequence Matching

In this work we develop a visual place recognition system for omnidirectional panoramic images that makes use of their full 360 degree circumferential angle of view. The system builds on our previous variant of the sequence SLAM algorithm to include panoramic image rotation alignment for improved image similarity scoring, and bi-directional query and database sequence matching within a Hidden M...

متن کامل

Hierarchical Multi-Modal Place Categorization

In this paper we present an hierarchical approach to place categorization. Low level sensory data is processed into more abstract concept, named properties of space. The framework allows for fusing information from heterogeneous sensory modalities and a range of derivatives of their data. Place categories are defined based on the properties that decouples them from the low level sensory data. T...

متن کامل

Multi-modal Semantic Place Classification

The ability to represent knowledge about space and its position therein is crucial for a mobile robot. To this end, topological and semantic descriptions are gaining popularity for augmenting purely metric space representations. In this paper we present a multi-modal place classification system that allows a mobile robot to identify places and recognize semantic categories in an indoor environm...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE Signal Processing Letters

سال: 2021

ISSN: ['1558-2361', '1070-9908']

DOI: https://doi.org/10.1109/lsp.2021.3123907